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IN THE CLAIMS: 

The text of all pending claims, (including withdrawn claims) Is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with ctrikothrough . The status of each 
claim is indicated with one of (original), (currently amended), (cancelled), (withdrawn), (new), 
(previously presented), or (not entered). 

Please AMEND 9 and 10 in accordance with the following: 
(CANCELED) 

^2>. (CANCELED) 



a voice information input part inputting voice information of a first user from a first user 
terminal; 

a voice recognition part conducting voice recognition with respect to the voice information 
and analyzing contents of the voice information; 

a voice information mediation part controlling a transmission path of the voice 
information in accordance with the analyzed contents of the voice information; 

an interaction engine extracting contents of a response corresponding to the voice 
information by referring to a knowledge database and creating a synthesized voice in 
accordance with the extracted contents of the response; and 

a voice information output partoutputting the synthesized voice, wherein the voice 
information mediation part monitors at all times an average reaction time, from a response of the 
interaction engine to a reaction of the first user, and in each of a case where the average 
reaction time exceeds a first threshold value that is an upper limit of a reaction time in an 
ordinary interaction and a case where the average reaction time is below a second threshold 
value that is a lower limit of the reaction time in the ordinary interaction, determines that an 
interaction between the first user and the Interaction engine is not being smoothly conducted and 
allows a third-party user to participate in the interaction between the first user and the interaction 
engine, as a helper, from a terminal other than the first user terminal. 




(PREVIOUSLY PRESENTED) A voice interactive system, comprising: 



-M*^ (CANCELED) 
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vv.^ >Sk (PREVIOUSLY PRESENTED) A voioe interactive system, comprising: 
^ / /eTvoice information input part Inputting voice information of a first user from a first user 
terminal; 

/a voice recognition part conducting voice recognition with respect to the voice information 
and analyzing contents of the voice information; 

-^a voice information mediation part controlling a transmission path of the voice 
information in accordance with the analyzed contents of the voice information; 

^/an interaction engine extracting contents of a response corresponding to the voice 
information by referring to a knowledge database and creating a synthesized voice in 
accordance with the extracted contents of the response; and 

a voioe information output part for outputting the synthesized voice, the voice information 
mediation part: 

monitoring at all times whether or not an Interaction between the first user and an 
interaction engine is being smoothly conducted and, in a case of determining that the 
Interaction is not being smoothly conducted, allowing a third-party user to participate in 
the interaction between the first user and the Interaction engine, as a helper, from a 
terminal other than the first user terminal; 

determining a progress of Interaction in accordance with an Intera ction time from 
^ ytff a beginning of the interaction between the first user and the interaction engine and the 
^ x , number of accesses from the first user terminal to the interaction engine; and 



. t>' — — 

°~ changing a participation mode of the third-party user successively, in an 

increasing order of progress of Interaction, from (1 ) involvement, to (2) parallel input, and 

^r^ 9 j>£ to (3) switching, and In a case where the participation mode is (1) involvement permitting 

'^^j the third-party user to be Involved in the interaction between the first user and the 

A ^^ a/ ^c* s ^ interaction engine, updating contents of the interaction from the interaction engine to the 

^ first user before the content of the interaction is output to the first user, in a case where 

^ V >so the participation mode is (2) parallel input, permitting the third-part user to conduct an 



lT ,nput with ^P 60 * to the interaction engine in parallel with the first user, and in a case 

y£ <r> where the participation mode is (3) switching, permitting the third-part user to directly 
interact with the first user in place of the interaction engine. 
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(PREVIOUSLY PRESENTED) A voice interactive system according to claim 3, 
wherein the interaction engine further includes an interaction history information storage part for 
recording interaction history on a first user basis, and a helper selection part for selecting the 
third-party user that is considered to be most familiar with the contents of the Interaction from the 
interaction history, as a helper, and the helper most appropriate for the contents of the voice 
information is selected. 

(PREVIOUSLY PRESENTED) A voice interactive system, comprising: 
a voice Information input part inputting voice information of a first user from a first user 
terminal; 

a voice recognition part conducting voice recognition with respect to the voice information 
and analyzing contents of the voice information; 

a voice information mediation part controlling a transmission path of the voice 
information In accordance with the analyzed contents of the voice information; 

an interaction engine extracting contents of a response corresponding to the voice 
information by referring to a knowledge database and creating a synthesized voice in 
accordance with the extracted contents of the response; and 

a voice information output part outputting the synthesized voice, wherein the voice 
information mediation part monitors at all times whether or not an interaction between the first 
user and the interaction engine Is being smoothly conducted and, In a case of determining that 
the user's interaction is not being smoothly conducted, allows a third-party user to participate in 
the interaction between the user and the interaction engine, as a helper, from a terminal other 
than the first user terminal; 

a help request notification part operative, in a case where the voice information 
mediation part determines that the interaction is not being smoothly conducted, to notify a third- 
party helper user of such fact, and: 

in a case where the help request notification part notifies the third-party user of the fact 
that the first user's interaction is not being smoothly conducted, the third-party user is capable of 
voluntarily Interacting with the first user, and 

in a case where it is detected that only a voice of the third-party helper user continues, for 
a predetermined period of time or longer, in an interaction between the third-party user and the 
first user, the interaction engine interacts only with the third-party user. 
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(PREVIOUSLY PRESENTED) A voice interactive system according to claim 3, 
further comprising 

an interaction history display part displaying the interaction history stored in the 
interaction history Information storage part to a third-party user; and 

a helper instruction part for receiving a help instruction from the third-party helper user, 
wherein: 

when the help instruction part receives the help Instruction from the third-party 
helper user, the voice information mediation part enables the interaction between the 
third-party helper user and the user to be conducted, and 

when a degree of help of the third-party helper user exceeds a predetermined 
threshold value in interaction between the third-party helper user and the first user, the 
interaction engine interacts only with the third-party helper user. 

AV^N^ (CURRENTLY AMENDED) A voice interactive method, comprising: 

inputting a first user's voice information from a first user terminal; 

conducting voice recognition with respect to the voice information, and analyzing 
contents of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 
contents of the voice information; 

outputto'ng a synthesized voice; 

controlling a transmission path of the voice information, comprising: 

extracting contents of a response corresponding to the voice information by referring to 

a knowledge database, and creating a synthesized voice in accordance with the contents of the 

response, and 

monitoring<it a l i tlmoo wh e th e r or not tho ucor'c Intoraot i on -i s - bolng cmoothty 
conduotodand, i n a oaao whoro i t I c determin e d thot tho ucor'c int e raction i o not boing smoothly 
conduct e d, allowing a third - party uoor to participate, as a - ho l por y in tho i nt e raction botwoon tho 
first us e r and on interaction onglno from another terminal /m onitoring at all times an average 
reaction time, from a response of the Interaction eng ine to a reaction of the first user and in 
each of a case where the average reaction time exceeds a first threshold value that is an upper 
limit of a reaction time i n an ordinary interaction and a case where the average reaction time is 
below a second threshold v alue that Is a lower limit of the reaction time In the ordinary 
Interaction, determining that an interacti on between the first user and the Interaction engine is 
not being smoothly conducte d and allowing a third-party user to participate in the interaction 
between the first user and the interactio n engine, as a helper, from a terminal other than the first 
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user terminal. 



(CURRENTLY AMENDED) A computer-readable medium storing a program to 




be read and executed by a computer for processing an input user's voice information, by. 
inputting a first user's voice Information; 

conducting voice recognition with respect to the voice information, and analyzing 

contents of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 

contents of the voice information; and 

outputting a synthesized voice, wherein: 

in the controlling of a transmission path of the voice information, contents of a 
response corresponding to the voice information being extracted by referring to a 
knowledge database, and a synthesized voice being created in accordance with the 
contents of the response, and 

in the controlling of the transmission path of the voice information, monitoring at 
a l l tim e s whothor or not tho u se r's i nteraction ?o boing smoothly conduotod and, in 0 oooo 
whoro it ic det e rmined that tho - uoor'c i nteraction i s not being smoothly conduoted t 
a l lowing a th i rd - parly us e r to part i cipate, ao a ho l por t in the intoraot i on - botwoon tho flrot 
user and on i nteraction e ngino from anothor torminah monitoring at all times an average 
reaction time, fr om a response of the interaction engine to a reaction of the first user. ap<fl 
in each of a ca se where the average reaction time exceeds a first threshold value that is 
an upper limit o f a reaction time in an ordinary Interaction and a case where the average 
reaction time Is below a second threshold value that is a lower limit of the reaction time in 
the ordinary Interaction, determining that an inte raction between the first user and the 
Interaction engine Is not being smoothly conducted and allowing a third-party user to 
participate in the interaction between the first user and the interaction engine, as a 
helper, from a terminal other than the first user terminal. 



- (PREVIOUSLY PRESENTED) A voice interactive system according to claim 5 t 

wherein the interaction engine further includes an interaction history information storage part for 
recording interaction history on a first user basis, and a helper selection part for selecting the 
third-party user that is considered to be most familiar with the contents of the interaction from the 
interaction history, and most appropriate for the contents of the voice Information. 
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V (PREVIOUSLY PRESENTED) A voice interactive system according to claim 7, 
wherein the interaction engine further includes an Interaction history information storage part for 
recording interaction history on a first user basis, and a helper selection part for selecting the 
third-party user that is considered to be most familiar with the contents of the Interaction from the 
interaction history, and most appropriate for the contents of the voice information. 

VW^^ Si ^S, ( PREVI0USLY PRESENTED ) A v0,ce interactive sy$ tem according to claim 5, 
*>- further comprising: 

an interaction history display part displaying the interaction history stored in the 
interaction history information storage part to a third-party user; and 

a helper instruction part for receiving a help instruction from the third-party helper user, 
wherein: 

when the help Instruction part receives the help instruction from the third-party 
helper user, the voice information mediation part enables the Interaction between the 
third-party helper user and the user to be conducted, and 

when a degree of help of the third-party helper user exceeds a predetermined 
threshold value in interaction between the third-party helper user and the first user, the 
interaction engine interacts only with the third-party helper user 

(ORIGINAL) A voice interactive system according to claim 7, further comprising 
an interaction history display part displaying the interaction history stored In the interaction 
history information storage part to a third-party user, and 

a helper Instruction part for receiving a help instruction from the third-party helper user, 
wherein: 

when the help instruction part reoeives the help Instruction from the third-party 
helper user, the voice information mediation part enables the interaction between the 
third-party helper user and the user to be conducted, and 

when a degree of help of the third-party helper user exceeds a predetermined 
threshold value in interaction between the third-party helper user and the first user, the 
interaction engine Interacts only with the third-party helper user. 
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"TS^ (CURRENTLY AMENDED) 



A voice interactive method, comprising: 



inputting voice information of a first user from a first user terminal; 
conducting voice recognition with respect to the voice information and analyzing contents 
of the voice information; 

controlling a transmission path of the voice information In accordance with the analyzed 
contents of the voice information; 

extracting contents of a response corresponding to the voice information by referring to a 
knowledge database and creating a synthesized voice in accordance with the extracted contents 
of the response; and 

outputting the synthesized voice, the voice Information mediation part 

monitoring at all times whether or not an Interaction between the first user and an 
interaction engine is being smoothly conducted and, in a case of determining that the 
interaction is not being smoothly conducted, allowing a third-party user to participate in 
the interaction between the first user and the Interaction engine, as a helper, from a 
terminal other than the first user terminal ; 

determining a progress of interaction in accordance with an interaction time from 
a beginning of the interaction between the first user and the interaction engine and the 
number of accesses from the first user terminal to the interaction engine; and 

changing a participation mode of the third-party user successively, in an 
increasing order of progress of interaction, from (1) involvement, to (2) parallel input, and 
to (3) switching, and In a case where the participation mode is (1) involvement, permitting 
the third-party user to be involved in the interaction between the first user and the 
interaction engine, updating contents of the interaction from the interaction engine to the 
first user before the content of the interaction is output to the first user, in a case where 
the participation mode is (2) parallel input, permitting the third-part user to conduct an 
input with respect to the interaction engine in parallel with the first user, and in a case 
where the participation mode is (3) switching, permitting the third-part user to directly 
interact with the first user in place of the interaction engine. 
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r (CURRENTLY AMENDED) A computer-readable medium storing a program to 

be read and executed by a computer for processing an input user's voice information, by: 
inputting voice information of a first user from a first user terminal; 
conducting voice recognition with respect to the voice information and analyzing contents 

of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 

contents of the voice Information; 

extracting contents of a response corresponding to the voice information by referring to a 
knowledge database and creating a synthesized voice in accordance with the extracted contents 
of the response; and 

outputtfng the synthesized voice, the voice information mediation part: 

monitoring at all times whether or not an interaction between the first user and an 
Interaction engine is being smoothly conducted and, in a case of determining that the 
interaction is not being smoothly conducted, allowing a third-party user to participate in 
the interaction between the first user and the interaction engine, as a helper, from a 
terminal other than the first user terminal ; 

determining a progress of interaction in accordance with an interaction time from 
a beginning of the interaction between the first user and the interaction engine and the 
number of accesses from the first user terminal to the interaction engine; and 

changing a participation mode of the third-party user successively, tn an 
increasing order of progress of interaction P from (1 ) involvement, to (2) parallel input, and 
to (3) switching, and in a case where the participation mode Is (1) Involvement, permitting 
the third-party user to be involved in the interaction between the first user and the 
interaction engine, updating contents of the interaction from the Interaction engine to the 
first user before the content of the interaction is output to the first user, in a case where 
the participation mode is (2) parallel input, permitting the third-part user to conduct an 
Input with respect to the interaction engine in parallel with the first user, and in a case 
where the participation mode is (3) switching, permitting the third-part user to directly 
interact with the first user in place of the interaction engine. 
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(PREVIOUSLY PRESENTED) A voice interactive method, comprising: 



inputting voice information of a first user from a first user terminal; 

conducting voice recognition with respect to the voice information and analyzing contents 
of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 
contents of the voice information; 

extracting contents of a response corresponding to the voice information by referring to a 
knowledge database and creating a synthesized voice in accordance with the extracted contents 
of the response; and 

outputting the synthesized voice, white monitoring at all times whether or not an 
interaction between the first user and the interaction engine Is being smoothly conducted and, in 
a case of determining that the user's interaction is not being smoothly conducted, allowing a 
third-party user to participate in the interaction between the user and the interaction engine, as a 
helper, from a terminal other than the first user terminal, and: 

in a case where the interaction is not being smoothly conducted, notifying a third- 
party helper user of such fact, 

in a case where the third-party user is notified of the fact that the first user's 

interaction is not being smoothly conducted, the third-party user is capable of voluntarily 

Interacting with the first user, and 

in a case where it is detected that only a voice of the third-party helper user 

continues, for a predetermined period of time or longer, in an interaction between the 

third-party user and the first user, controlling the interaction engine to interact only with 

the third-party user 



(PREVIOUSLY PRESENTED) A computer-readable medium storing a program 



to be read and executed by a computer for processing an input user's voice information, by: 

inputting voice information of a first user from a first user terminal; 

conducting voice recognition with respect to the voice information and analyzing contents 
of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 
contents of the voice Information; 

extracting contents of a response corresponding to the voice information by referring to a 
knowledge database and creating a synthesized voice in accordance with the extracted contents 
of the response; and 

outputting the synthesized voice, while monitoring at all times whether or not an 
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interaction between the first user and the interaction engine is being smoothly conducted and, In 
a case of determining that the user's interaction Is not being smoothly conducted, allowing a 
third-party user to participate in the interaction between the user and the interaction engine, as a 
helper, from a terminal other than the first user terminal, and: 

in a case where the interaction is not being smoothly conducted, notifying a third- 
party helper user of such fact, 

in a case where the third-party user is notified of the fact that the first user's 
interaction Is not being smoothly conducted, the third-party user is capable of voluntarily 
interacting with the first user, and 

in a case where it is detected that only a voice of the third-party helper user continues, for 
a predetermined period of time or longer, in an interaction between the third-parly user and the 
first user, controlling the interaction engine to interact only with the third-party user. 
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